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Load Balancing Device Communications 
FIELD 

[0001] Embodiments of this invention relate to load balancing device 

communications. 

BACKGROUND 

[0002] Embodiments of the invention may relate to controllers that may manage 

communications sent to one or more other devices (hereinafter referred to as "devices"). 
For example, an I/O (input/output) storage controller may control the sending and 
receiving of I/O requests between computer systems (and/or components on computer 
systems), for example, and peripheral storage devices. Since controllers may have a 
finite amount of bandwidth that is available for managing communications to devices at a 
given time, it is important to appropriately balance the available controller bandwidth 
among the devices. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0003] Embodiments of the present invention are illustrated by way of example, 

and not by way of limitation, in the figures of the accompanying drawings and in which 
like reference numerals refer to similar elements and in which: 

[0004] FIG. 1 illustrates a network. 

[0005] FIG. 2 illustrates a system. 
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[0006] 



FIG. 3 illustrates a system embodiment. 



[0007] 



FIG. 4 is a flowchart illustrating a method embodiment. 



[0008] 



FIGS. 5-8 illustrate a first example according to an exemplary 



embodiment. 



[0009] 



FIGS. 9-12 illustrate a second example according to an exemplary 



embodiment. 



DETAILED DESCRIPTION 



[0010] 



Embodiments of the present invention include various operations, which 



will be described below. The operations associated with embodiments of the present 
invention may be performed by hardware components or may be embodied in machine- 
executable instructions, which when executed may result in a general-purpose or special- 
purpose processor or circuitry programmed with the instructions performing the 
operations. Alternatively, and/or additionally, some or all of the operations may be 
performed by a combination of hardware and software. 

[0011] Embodiments of the present invention may be provided, for example, as a 

computer program product which may include one or more machine-readable media 
having stored thereon machine-executable instructions that, when executed by one or 
more machines such as a computer, network of computers, or other electronic devices, 
may result in the one or more machines carrying out operations in accordance with 
embodiments of the present invention. A machine-readable medium may include, but is 
not limited to, floppy diskettes, optical disks, CD-ROMs (Compact Disc-Read Only 
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Memories), and magneto-optical disks, ROMs (Read Only Memories), RAMs (Random 
Access Memories), EPROMs (Erasable Programmable Read Only Memories), 
EEPROMs (Electrically Erasable Programmable Read Only Memories), magnetic or 
optical cards, flash memory, or other type of media / machine-readable medium suitable 
for storing such instructions. 

[0012] Moreover, embodiments of the present invention may also be downloaded 

as a computer program product, wherein the program may be transferred from a remote 
computer (e.g., a server) to a requesting computer (e.g., a client) by way of one or more 
data signals embodied in and/or modulated by a carrier wave or other propagation 
medium via a communication link (e.g., a modem and/or network connection). 
Accordingly, as used herein, a machine-readable medium may, but is not required to, 
comprise such a carrier wave. 

[001 3] Examples described below are for illustrative purposes only, and are in no 

way intended to limit embodiments of the invention. Thus, where examples may be 
described in detail, or where a list of examples may be provided, it should be understood 
that the examples are not to be construed as exhaustive, and do not limit embodiments of 
the invention to the examples described and/or illustrated. 

Introduction 

[0014] FIG. 1 illustrates one example of a network 100 in which embodiments of 

the invention may be carried out. Network 100 may comprise, for example, one or more 
computer nodes 102 A . . . 102N (hereinafter "nodes") communicatively coupled together 
via a communication medium 104. Nodes 102 A . . . 102N may transmit and receive sets 
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of one or more signals via medium 104 that may encode one or more packets. As used 
herein, a "packet" means a sequence of one or more symbols and/or values that may be 
encoded by one or more signals transmitted from at least one sender to at least one 
receiver. 

[001 5] As used herein, a "communication medium" 104 means a physical entity 

through which electromagnetic radiation may be transmitted and/or received. Medium 
104 may comprise, for example, one or more optical and/or electrical cables, although 
many alternatives are possible. For example, medium 104 may comprise, for example, 
air and/or vacuum, through which nodes 102 A . . . 102N may wirelessly transmit and/or 
receive sets of one or more signals. 

[0016] In network 100, one or more of the nodes 102 A . . . 102N may comprise 

one or more intermediate stations, such as, for example, one or more hubs, switches, 
and/or routers; additionally or alternatively, one or more of the nodes 102A . . . 102N 
may comprise one or more end stations. Also additionally or alternatively, network 100 
may comprise one or more not shown intermediate stations, and medium 104 may 
communicatively couple together at least some of the nodes 102A . . . 102N and one or 
more of these intermediate stations. Of course, many alternatives are possible. 

[001 7] FIG. 2 illustrates system 200. System 200 may be a node 102A . . . 102N 

in network 100. System 200 may comprise host processor 202, host memory 204, bus 
206, and chipset 208. Host processor 202 may be coupled to chipset 208. Host processor 
202 may comprise, for example, an Intel® Pentium® HI or IV microprocessor that is 
commercially available from the Assignee of the subject application. Of course, 
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alternatively, host processor 202 may comprise another type of microprocessor, such as, 
for example, a microprocessor that is manufactured and/or commercially available from a 
source other than the Assignee of the subject application, without departing from this 
embodiment. 

[001 8] Chipset 208 may comprise a host bridge/hub system that may couple host 

processor 202, host memory 204, and a user interface system 214 to each other and to bus 
206. Chipset 208 may also include an I/O bridge/hub system (not shown) that may 
couple the host bridge/bus system 208 to bus 206. Chipset 208 may comprise one or 
more integrated circuit chips, such as those selected from integrated circuit chipsets 
commercially available from the Assignee of the subject application (e.g., graphics 
memory and I/O controller hub chipsets), although other one or more other integrated 
circuit chips may also, or alternatively, be used. User interface system 214 may 
comprise, e.g., a keyboard, pointing device, and display system that may permit a human 
user to input commands to, and monitor the operation of, system 200. 

[001 9] Bus 206 may comprise a bus that complies with the Peripheral Component 

Interconnect (PCI) Local Bus Specification, Revision 2.2, December 18, 1998 available 
from the PCI Special Interest Group, Portland, Oregon, U.S.A. (hereinafter referred to as 
a "PCI bus")- Alternatively, bus 206 instead may comprise a bus that complies with the 
PCI-X Specification Rev. 1.0a, July 24, 2000, available from the aforesaid PCI Special 
Interest Group, Portland, Oregon, U.S.A. (hereinafter referred to as a 'PCI-X bus"). 
Also, alternatively, bus 206 may comprise other types and configurations of bus systems. 

[0020] System 200 may comprise one or more memories to store program 
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instructions 230, 232 capable of being executed, and/or data capable of being accessed, 
operated upon, and/or manipulated by processor, such as host processor 202, and/or 
circuitry, such as circuitry 226. These one or more such memories may include, for 
example host memory 204, and/or memory 228 in circuitry 226. Memories 204, 228 may 
comprise read only, mass storage, and/or random access computer-readable memory. 
The execution of program instructions 230, 232 and/or the accessing, operation upon, 
and/or manipulation of this data by the host processor 202 and/or circuitry 226 may result 
in, for example, host processor 202 and/or circuitry 226 carrying out the operations 
described herein as being carried out by host processor 202 and/or circuitry 226. 

[0021] Host processor 202, host memory 204, bus 206, chipset 208, and circuit 

card slot 216 may be comprised in a single circuit board, such as, for example, a system 
motherboard 218. Circuit card slot 216 may comprise a PCI expansion slot that 
comprises a PCI bus connector 220. PCI bus connector 220 may be electrically and 
mechanically mated with a PCI bus connector 222 that is comprised in circuit card 224. 
Circuit card slot 216 and circuit card 224 may be constructed to permit circuit card 224 to 
be inserted into circuit card slot 216. When circuit card 224 is inserted into circuit card 
slot 216, PCI bus connectors 220, 222 may become electrically and mechanically coupled 
to each other. When PCI bus connectors 220, 222 are so coupled to each other, circuitry 
226 in circuit card 224 may become electrically coupled to bus 206. 

[0022] FIG. 3 illustrates a system embodiment of the invention that may be 

implemented in one or more components of system 200. System 300 may include 
controller 302, and load balancer 304. System 300 may be a computer system, such as 
system 200 that may communicate with one or more devices 308 A ... 308N. System 300 
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and one or more devices 308 A . . . 308N may each be a node 102 A . . . 102N in network 
100 that may communicate via medium 104. Additionally or alternatively, one or more 
devices 308 A . . . 308N may be directly connected to system 300. 

[0023] A "device" 308 A . . . 308N means a machine or a process that may send 

and receive one or more communications via controller 302. Device 308 A . . . 308N may 
comprise, for example, a hardware component, such as a disk drive or any type of storage 
peripheral, where the device may be connected to system 300 directly or via a network; a 
software process, such as an application program; or even a virtual device. Each device 
308 A . . . 308N may each be associated with a device request queue to 3 12A . . . 312N on 
system 300 to store one or more communications destined for device 308 A . . . 308N. 
Each device 308A ... 308N may also be associated with a priority 310A ... 3 10N. 

[0024] A "communication", as used herein, means data from a sending device 

that may be destined for one or more devices 308 A . . . 308N via controller 302. 
"Sending device", as used herein, may comprise a system, such as system 300, another 
system, such as system 200, and/or one or more hardware and/or software components, 
such as an operating system, on a system, such as system 200, 300. For example, data 
may comprise a request to store data on storage media (not shown) associated with 
devices 308 A ... 308N. More generally, however, communication means data 300 sent 
via controller 302. In embodiments of the invention, data may comprise storage requests. 
However, embodiments of the invention are not limited to data of this type. 

[0025] "Controller" 302 refers to a device that may manage one or more 

communications from a sending device to one or more devices 308A . . . 308N. In one 
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embodiment, controller 302 may be associated with controller request queue 314 to store 
one or more communications removed from device request queue 312A ... 312N to be 
transmitted to one or more devices 308 A . . . 308N by controller 302. Controller request 
queue 3 14 may be a memory, such as memory 204, that may store one or more 
communications to be sent to devices 308A ... 308N. 

[0026] Load balancer 304 may balance the available controller bandwidth across 

one or more active devices 308A ... 308N. An "active device" is a device which may 
have one or more communications in controller request queue 314, or which may have 
one or more communications in device request queue 312A ... 312N. Conversely, an 
inactive device is a device that does not have any outstanding communications in the 
controller's request queue 314, or any communications in device request queue 312A ... 
312N. 

[0027] In one embodiment, bandwidth may be measured in terms of the number 

of VO requests that controller 302 can handle, or the number of I/O requests that each 
device 308 A ... 308N can have outstanding in controller request queue 314. In 
embodiments of the invention, load balancer 304 may run at predetermined intervals, for 
example. Embodiments of the invention are not limited to predetermined intervals, 
however, and load balancer 304 may run in accordance with other periods without 
departing from embodiments of the invention. As used herein, each time that load 
balancer 304 runs may be referred to as an iteration. 

[0028] Controller 302 may be comprised, for example, in a combination of 

hardware and firmware. For example, controller 302 may be comprised in a chipset, such 
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as chipset 208. Also, for example, controller 302 may be comprised in circuit card 224 
that may be inserted into a circuit card slot 216 on system motherboard 218, for example. 
Some or all of controller 302 functionality may be programmed and stored in computer- 
readable memory, such as memory 204, or memory 228. 

[0029] Load balancer 304 and/or device request controller 306 may be comprised 

in software. Load balancer 304 functionality and/or device request controller 
functionality 306 may be programmed and stored in computer-readable memory, such as 
in host memory 204, or memory 228. Many alternatives are possible. For example, load 
balancer 304 and device request controller 306 may both be comprised in a single circuit 
card, such as circuit card 224 that may be inserted into circuit card slot, such as circuit 
card slot 216. Alternatively, load balancer 304 and device request controller 306 may be 
individually comprised in a single circuit card, such as circuit card 224 that may be 
inserted into circuit card slot, such as circuit card slot 216. Alternatively, load balancer 
304 and device request controller 306 may be part of a chipset, such as chipset 208. For 
example, load balancer 304 and device request controller 306 may be part of a controller 
chipset 208. 

[0030] . In one embodiment, as illustrated below, controller 302 may be a storage 
controller for one or more devices 308A . . . 308N, such as peripheral storage devices. In 
one embodiment, controller 302 may manage one or more I/O requests to one or more 
devices 308A . . . 308N. Additionally in this embodiment, system 300 may additionally 
comprise device request controller 306 to manage controller request queue 314. The 
amount of controller 302 bandwidth load balancer 304 may allocate to each device 308A 
... 308N may be reported to device request controller 306. Device request controller 306 
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may use this allocation to control how many requests from device request queue 312A ... 
312N are removed and added to controller request queue 314. For example, if a device 
308A . . . 308N has not exceeded its bandwidth limit, then device request controller 306 
may take a request from the device request queue 312A ... 312N, and place it in 
controller request queue 314. Device request controller 306 may increment the number 
of requests on device request queue 312A ... 312N in accordance with requests that 
system 300 has received. Device request controller 306 may decrement the number of 
requests on device request queue 312A ... 312N in accordance with requests that have 
been removed from device request queue 312A ... 312N and placed in controller request 
queue 3 14 to be sent to device 308 A . . . 308N. Device request controller 306 may service 
each device 308A . . . 308N in round robin order; however, many alternatives are 
possible. 

[0031] In one embodiment, as illustrated below, load balancer 304 may be part of 

a software driver for an operating system, such as for system 300, for example. The 
operating system software driver may communicate with controller 302 that may service 
one or more devices 308 A . . . 308N, and may balance the communication load from 
controller 302 to one or more devices 308 A ..^308N . Alternatively, load balancer 304 
may be part of the controller 302, and controller 302 may balance the communication 
load sent to one or more devices 308A . . . 308N from another component on system 300. 
Another alternative is that load balancer 304 may be part of an operating system software 
driver that may balance the communication load sent to one or more devices 308 A . . . 
308N from another software driver. 

[0032] Dlustrative embodiments may describe load balancer 304 as balancing I/O 
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requests on controller 302 sent to one or more devices 308A-. , . 308N; In these 
embodiments, embodiment-specific terms may be used for illustrative purposes. 
However, terms, such as I/O requests, are not intended to limit embodiments of the 
invention. The terms, instead, should aid in one's understanding of embodiments of the 
invention, and how embodiments of the invention may be applicable in other scenarios. 

[0033] In one illustrated embodiment, it may be assumed that there are devices 

308 A . . . 308N represented by notations 0-N associated with a controller 302, where any 
given one of the 0-N devices may be arbitrarily represented by the notation M. The 
following variables, constants, and/or terms may be used by load balancer 304 in 
accordance with embodiments of the invention: 

[0034] ACTIVE DEVICE may represent a device 308 A . . . 308N that has a 

TOTAL REQUESTED BANDWIDTH > 0. 

[0035] ACTIVE B ANDWIDTH[M] may represent a number of requests for 

device M that have been sent to controller 302, and are outstanding on controller request 
queue 314 for device M. This number should remain less than or equal to the ACTIVE 
BANDWIDTH LIMITfM] (see below). 

[0036] ACTIVE BANDWIDTH LEMIT[M] may represent a maximum amount of 

bandwidth (i.e., number of requests in one embodiment) that may be active on controller 
request queue 314 for device M. During an iteration, this may represent the initial 
bandwidth allotment for each active device, which may be the greater of the AVG 
BANDWIDTH and the MIN BANDWIDTH. During the iteration, this value may be 
incremented for devices 308A ... 308N that require extra bandwidth, and decremented 
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for devices 308A ... 308N that have extra bandwidth. 

[0037] AVG BANDWIDTH may represent an amount of bandwidth (i.e., number 

of requests in one embodiment) allocated to each active device based on the maximum 
bandwidth (MAX BANDWIDTH) and the number of active devices (ACTIVE 
DEVICE). If this amount is greater than MIN BANDWIDTH, the initial bandwidth 
allotment (ACTIVE BANDWIDTH UM1T[M]) is set to AVG BANDWIDTH. 

[0038] DEVICE COUNT may initially represent a number of active devices. 

This number is subsequently reset to 0, and may then represent the number of devices 
requiring more bandwidth. 

[0039] GIVE BANDWIDTH[M] may represent an amount of bandwidth (i.e., 

number of requests in one embodiment) below the initial bandwidth allotment to device 
M, that is not required by device M. 

[0040] INACTIVE DEVICE: may represent a device that has a TOTAL 

REQUESTED BANDWIDTH = 0. 

[0041 ] MAX BANDWIDTH may be the maximum amount of bandwidth (i.e., 

number of requests in one embodiment) that controller 302 can handle, and may be 
reported by controller 302. This represents the maximum number of communications 
requests that can be queued to controller request queue 314 at any given point in time. 
Thus, the total of ACTIVE BANDWIDTH LEVHT[M] for all devices should be less than 
or equal to MAX BANDWIDTH. 

[0042] MIN BANDWIDTH may represent an amount of bandwidth (i.e., number 
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of requests in one embodiment) that may be guaranteed to each device 308A . . . 308N. 
This may be a predetermined number, or a dynamically determined number. If AVG 
BANDWIDTH is less than MIN BANDWIDTH, the initial bandwidth allotment 
(ACTIVE BANDWIDTH LIMIT[M]) is set to MIN BANDWIDTH. 

[0043] PRIORITY[M] may indicate that device M is associated with a priority. 

In embodiments of the invention, controller 302 may determine that a device 308 A ... 
308N is a priority device, and may associate the device with a priority 3 10A. ... 3 ION 
(hereinafter "priority device"). In one embodiment, controller 302 may associate a 
device 308 A ... 308N with a priority 31 OA ... 3 10N by setting the device's priority flag 
(e.g., PRIORITY[M] = 1). In other embodiments, controller 302 may associate the 
device 308 A ... 308N with a priority 31 OA ... 3 10N by assigning a priority to the device, 
for example. This flag (or priority assignment) may indicate that a device should be 
allocated more bandwidth because a request associated with that device is a high priority 
request. For example, a device may be a priority device if a request is sent to the device, 
and controller 302 knows that the device contains the operating system, in which case 
controller 302 may associate the device with a priority. PRIORITY[M] may result in 
load balancer 304 behaving differently for devices that have their PRIORITYfM] flags 
set (e.g., PRIORITY[M] = 1) versus devices that do not (e.g., PRIORITY[M] = 0). In 
other embodiments, PRIORITY [M] may have a value other than set or disabled (0, 1). 
For example, PRIORITY [M] may indicate a priority level, such that a higher priority 
level may allow more bandwidth to be allocated to the corresponding device. 

[0044] PRIORITY COUNT may represent the number of priority devices. 
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[0045] QUEUE B ANDWIDTH[M] may represent a number of requests that have 

been queued to device request queue, 312A ... 312N. This value may be incremented 
each time a request is added to device request queue 312A ... 312N, and decremented 
each time a request is removed from device request queue 312A ... 312N. 

[0046] RES BANDWITH may be an amount that is set aside to allow any device 

308 A . . . 308N to get bandwidth at any time to avoid request latency. For example, if a 
device 308 A . . . 308N is not taken into account during an iteration, and subsequently (to 
the current iteration, but before a subsequent iteration) requests bandwidth, then the 
device 308A . . . 308N may use up to RES BANDWIDTH. Put another way, RES 
BANDWIDTH is an amount of bandwidth set aside for one or more devices 308A . . . 
308N that may be initially inactive during an iteration. This may be a predetermined 
number, such as for each iteration, or a dynamically determined number that may be 
changed for different iterations, for example. 

[0047] TOTAL REQUESTED B ANDWIDTH[M] may represent the total of the 

amount of bandwidth in device M's request queue 312A ... 312N (QUEUE 
BANDWEDTH[M]) and the amount of bandwidth in controller request queue 314 for 
device M (ACTIVE BANDWIDTH[M]). 

[0048] TOTAL EXTRA BANDWIDTH may represent the total amount of extra 

bandwidth that is not being utilized by the active devices. 

[0049] FIG. 4 is a flowchart illustrating one embodiment, where each block may 

illustrate one or more operations that may be performed by load balancer 304. The 
description of the method set forth below may refer to the variables, constants, and/or 
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terms described above. These variables, constants, and/or terms are shown in capitalized 
text. 

[0050] The method begins at block 400 and continues to block 402 where load 

balancer 304 may determine if there are one or more active devices from among a 
plurality of devices 308A . . . 308N associated with controller 302 (the number of active 
devices may be represented by DEVICE COUNT). In one embodiment of the invention, 
a device may be active if its total requested bandwidth (TOTAL REQUESTED 
BANDWEDTH[M]) is greater than 0. 

[0051 ] At block 404, if none of the devices 308 A . . . 308N are active, then load 

balancer 304 may set the bandwidth limit (ACTIVE BANDWIDTH LIMIT [M]) for each 
of the plurality of devices to an adjusted maximum bandwidth. In one embodiment, the 
adjusted maximum bandwidth may comprise a portion of the maximum bandwidth 
(MAX BANDWIDTH). As discussed above, the adjusted maximum bandwidth may 
comprise the difference between the maximum bandwidth (MAX BANDWIDTH), and a 
reserved bandwidth (RES BANDWIDTH). The method then ends at block 416. 

[0052] At block 406, if one or more of the devices 308 A . . . 308N is active, then 

load balancer 304 may set an initial bandwidth limit (ACTIVE BANDWIDTH 
LIMIT[M]) for each of a plurality of active devices associated with controller 302. In 
one embodiment, the initial bandwidth limit may be set to the greater of an average 
bandwidth (AVG BANDWIDTH) and a minimum bandwidth (MIN BANDWIDTH). In 
one embodiment, the average bandwidth (AVG BANDWIDTH) may be set to the 
difference between the maximum bandwidth and a reserved bandwidth (RES 
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BANDWIDTH) divided by the number of active devices (DEVICE COUNT). 

[0053] At block 408, load balancer 304 may determine a total amount of extra 

bandwidth (TOTAL EXTRA BANDWIDTH) from the plurality of active devices that 
have extra bandwidth, and a number of the active devices that require extra bandwidth. 
Load balancer 304 may determine the total amount of extra bandwidth by determining 
which of the active devices have extra bandwidth, and how much for each of those 
devices (GIVE BANDWIDTH[M]). Load balancer 304 may determine the number of 
active devices that require extra bandwidth by determining which of the active devices 
require more bandwidth than initially allocated (TOTAL REQUESTED 
BANDWEDTH[M] < initial bandwidth allotment), and which of the active devices are 
associated with a priority ( PRIORITY[M] = 1). 

[0054] At block 410, load balancer 304 may determine if there is extra 

bandwidth, and if there are one or more of the plurality of active devices that require 
extra bandwidth. In embodiments of the invention, there is extra bandwidth if TOTAL 
EXTRA B ANDWDITH > 0, and there are devices that require extra bandwidth if 
DEVICE COUNT > 0 or PRIORITY COUNT > 0. If there is no extra bandwidth and/or 
there are no devices that require extra bandwidth, then the method ends at block 414. 

[0055] At block 412, if there is extra bandwidth and if one or more of the 

plurality of active devices require extra bandwidth, load balancer 304 may adjust the 
bandwidth limit by reallocating the extra bandwidth to the one or more plurality of active 
devices that require extra bandwidth. In one embodiment, load balancer 304 does this by 
decreasing the bandwidth limit (ACTIVE BANDWIDTH LIMIT [M]) by the extra 
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bandwidth from those devices that have extra bandwidth, and by increasing the 
bandwidth limit (ACTIVE BANDWIDTH LIMIT[M]) of a select set of the one or more 
plurality of active devices that require extra bandwidth. In one embodiment, the 
bandwidth limit is increased by an add count (ADD COUNT). In one embodiment, 
illustrated in examples below, the add count may be an amount based on the total extra 
bandwidth. In another embodiment, the add count may be an amount based on both the 
total extra bandwidth (TOTAL EXTRA BANDWIDTH), and on the required bandwidth 
for each device requiring more bandwidth For example, the total extra bandwidth could 
be allocated in an amount proportional to the amount of bandwidth needed by a given 
device. 

[0056] The select set of the one or more of plurality of active devices that require 

extra bandwidth may include the total number of devices in the current iteration that 
require extra bandwidth (i.e., DEVICE COUNT + PRIORITY COUNT); the number of 
devices that require extra bandwidth because the initial bandwidth allocation is not 
enough (DEVICE COUNT); or the number of priority devices (PRIORITY COUNT). 
The select set may comprise one or more of the active devices. In illustrated 
embodiments, the select set of the one or more of the plurality of active devices that 
require extra bandwidth may include one of: one or more of the active devices that may 
require extra bandwidth because the initial bandwidth allocation is not enough (devices 
that contribute to DEVICE COUNT); or one or more of the active devices that are 
priority devices (devices that contribute to PRIORITY COUNT). 

[0057] The method ends at block 414. 
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Exemplary Embodiment 

[0058] In an exemplary embodiment, the following load balancer 304 operations 
may result from each iteration: 

[0059] 1. Set DEVICE COUNT to determine if there are any active devices 

(402). 

[0060] DEVICE COUNT may be set to the total number of devices where 
TOTAL REQUESTED BANDWIDTH[M]>0 (i.e., QUEUE BANDWIDTH[M]>0, or 
ACTIVE BANDWIDTH[M]>0). 

[0061 ] TOTAL REQUESTED BANDWIDTH [M] = QUEUE BANDWIDTH[M] 

+ ACTIVE BANDWIDTH[M]. 

[0062] 2. If there are no active devices (404, e.g., if DEVICE COUNT = 0), 

then for each device M of 0-N devices, set ACTIVE BANDWIDTH LIMIT [M] = 
MAX BANDWIDTH - RES BANDWIDTH. 

[0063] If there are one or more active devices (406, e.g., DEVICE COUNT > 

0), then set ACTIVE BANDWIDTH LIMIT [M] = AVG BANDWIDTH for the one 
or more active devices. 

[0064] AVG BANDWIDTH = (MAX BANDWIDTH - RES 

BANDWIDTH)/DEVICE COUNT. 

[0065] If AVG BANDWIDTH < MIN BANDWIDTH, then set AVG 

BANDWIDTH = MEN BANDWIDTH. 
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[0066] If there are one or more active devices, and any remaining devices 

that are not active, then set ACTIVE BANDWIDTH LIMIT[M] = 0 for the 
remaining devices that are not active. (These remaining inactive devices may still 
use RES BANDWIDTH if they require extra bandwidth during the current 
iteration.) 

[0067] 3. For each active device, determine the total extra bandwidth, and 

the number of devices requiring extra bandwidth (408). 

[0068] Reset DEVICE COUNT = 0, and set PRIORITY COUNT = 0. 

[0069] Extra bandwidth : for each active device M, 

[0070] If TOTAL REQUESTED BANDWIDTH[M] < ACTIVE BANDWIDTH 

LIMIT[M], then GIVE BANDWIDTH [M] = (ACTIVE BANDWIDTH LIMIT [M] - 
TOTAL REQUESTED BANDWIDTH[M]). 

[0071 ] TOTAL EXTRA BANDWIDTH = E(0-N)(GIVE BANDWIDTH[M]). 

[0072] Devices requiring extra bandwidth - for each active device M: 

[0073] If TOTAL REQUESTED BANDWIDTH[M] > ACTIVE BANDWIDTH 

LIMIT[M], then DEVICE COUNT = DEVICE COUNT + 1. 

[0074] If PRIORlTY[M] = 1 , then PRIORITY COUNT = PRIORITY COUNT + 

1. 

[0075] 4. If there is extra bandwidth, and devices that require extra 

bandwidth (i.e., (TOTAL EXTRA BANDWIDTH > 0) AND (DEVICE COUNT > 0 



Docket No.: P1 71 49 19 
Express Mail Label: EL 962028175 US 



Utility Patent Application 



OR PRIORITY COUNT > 0)) (410), then determine an amount that may be added 
(ADD COUNT) to the ACTIVE BANDWIDTH LIMIT[M] for the one or more of 
the devices that require extra bandwidth. In embodiments of the invention, priority 
devices may have higher priority than other devices requiring more bandwidth. 
Therefore, if there are priority devices, these devices may share in the extra 
bandwidth to the exclusion of other active devices requiring extra bandwidth. If 
there are no priority devices, then the devices requiring more bandwidth may share 
in the extra bandwidth: 

[0076] If PRIORITY COUNT > 0, then ADD COUNT = TOTAL EXTRA 

BANDWIDTH/PRIORITY COUNT. 

[0077] If PRIORITY COUNT = 0, then ADD COUNT = TOTAL EXTRA 

BANDWIDTH/DEVICE COUNT. 

[0078] In embodiments of the invention, the total ACTIVE BANDWIDTH 

LIMIT[M] should not exceed (MAX BANDWIDTH - RES BANDWIDTH), so numbers 
may be rounded down to the next whole number, if necessary. 

[0079] 5. Decrease the ACTIVE BANDWIDTH LIMIT[M] for those devices 
that have extra bandwidth (412) by GIVE BANDWIDTHfM], and increase the 
ACTIVE BANDWIDTH LIMITfM] of one or more of the active devices requiring 
extra bandwidth by ADD COUNT (412). 

[0080] ACTIVE BANDWIDTH LIMIT[M] for each of the devices that have 

extra bandwidth is decreased by a corresponding GIVE BANDWIDTHfM]. 
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[0081 ] If PRIORITY COUNT > 0, then ACTIVE BANDWIDTH LIMIT[M] = 

ACTIVE BANDWIDTH UMIT[M] + ADD COUNT for each priority device (e.g., 
devices where PRIORITY[M]=l, those that contributed to PRIORITY COUNT). This 
may be the amount of bandwidth that may be added to each priority device's ACTIVE 
BANDWIDTH LEVHT1M] to allow it to use more bandwidth. 

[0082] If PRIORITY COUNT = 0, then ACTIVE BANDWIDTH LEvltT[M] = 

ACTIVE BANDWIDTH LIMIT [M] + ADD COUNT for each device requiring more 
bandwidth by virtue of having more requests than allocated (i.e., those that contributed to 
DEVICE COUNT). This may be the total amount of bandwidth that may be added to 
each device's ACTIVE BANDWIDTH LIMIT [M] to allow it to use more bandwidth. 

[0083] Load balancer 304 may allocate ACTIVE BANDWIDTH LEvlIT[M] to 

each device (416). Device request controller 306 may use this information to control the 
sending of requests from controller 302 to devices 308A . . . 308N . 

Example 1 - No Devices Associated With a Priority 

[0084] FIGS. 5-8 illustrate a first example of the exemplary embodiment 

described above. In this example, MAX BANDWIDTH = 82 (560), RES BANDWIDTH 
= 2 (562), MIN BANDWIDTH = 10 (564) and devices 500, 502, 504, 506, 508 are 
attached to controller 302 (not shown in this example). 

[0085] FIG. 5 illustrates the following: 

[0086] None of the devices 500, 502, 504, 506, 508 have their priority flag set 

(PRIORITY[500] = 0 (510); PRIORITY[502] = 0 (520); PRIORITY[504] = 0 (530); 
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PRIORITY[506] = 0 (540); PRIORITY[508] = 0 (550)). 

[0087] Device 500 may have a total requested bandwidth 512 of 10 requests 

(QUEUE BANDWIDTH = 10 (514); ACTIVE BANDWIDTH = 0 (516)). 

[0088] Device 502 may have a total requested bandwidth 522 of 5 requests 

(QUEUE BANDWIDTH = 0 (524); ACTIVE BANDWIDTH = 5 (526). 

[0089] Device 504 may have a total requested bandwidth 532 of 60 requests 

(QUEUE BANDWIDTH = 40 (534); ACTIVE BANDWIDTH = 20 (536)). 

[0090] Device 506 may have a total requested bandwidth 542 of 50 requests 

(QUEUE BANDWIDTH = 30 (544); ACTIVE BANDWIDTH = 20 (546)). 

[0091 ] Device 508 may have a total requested bandwidth 552 of 0 requests 

(QUEUE BANDWIDTH = 0 (554); ACTIVE BANDWIDTH = 0 (556)). 

[0092] 1. Set DEVICE COUNT to determine if there are any active devices. 

[0093] DEVICE COUNT may be set to the total number of devices where 

TOTAL REQUESTED BANDWIDTH rMl>0 (i.e., QUEUE BANDWrDTHfMl>0. or 
ACTIVE BANPWIDTHfMl>0). 

[0094] TOTAL REQUESTED BANDWIDTHfMl = QUEUE BANDWIDTHrMl 

+ ACTIVE BANDWIDTHrMl. 

[0095] TOTAL REQUESTED BANDWIDTH [500] (512) = 10 + 0=10. 

[0096] TOTAL REQUESTED BAND WIDTH [ 502 ] (522) = 0 + 5 = 5. 
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[0097] TOTAL REQUESTED BAND WIDTH [ 504 ] (532) = 40 + 20 = 60. 

[0098] TOTAL REQUESTED BANDWIDTH [506] (542) = 30 + 20 = 50. 

[0099] TOTAL REQUESTED BAND WIDTH [ 508 ] (552) = 0 + 0 = 0. 

[001 00] DEVICE COUNT = 4 (566) (500, 502, 504, 506). 
[001 01 ] FIG. 6 illustrates the following: 

[001 02] 2, If there are no active devices (e.g., if DEVICE COUNT = 0), then 
for each device M of O N devices, set ACTIVE BANDWIDTH LIMIT [M] = MAX 
BANDWIDTH - RES BANDWIDTH. 

[001 03] Not applicable, since there are four (4) active devices. 

[001 04] If there are one or more active devices (e.g., DEVICE COUNT > 0), 
then set ACTIVE BANDWIDTH LIMIT[M] = AVG BANDWIDTH for the one or 
more active devices. 

[00105] AVG BANDWIDTH = (MAX BANDWIDTH - RES 
BANDWIDTHyDEVICE COUNT . 

[001 06] A VG BANDWIDTH = (82 - 2 )/4 = 80/4 = 20 (610). 
[001 07] AVG BANDWIDTH (610)) > MIN BANDWIDTH (564). 
[001 08] ACTIVE BANDWIDTH LIMIT[500] = 20 (600). 
[00109] ACTIVE BANDWIDTH LIMIT[502] = 20 (602). 
[001 1 0] ACTIVE BANDWIDTH LIMIT[504] = 20 (604). 

Docket No.: P1 71 49 23 Utility Patent Application 

Express Mail Label: EL 962028175 US 



[00111] ACTIVE BANDWIDTH LIMIT[506] = 20(606). . 

[00112] If AVG BANDWIDTH < MIN BANDWIDTH, then set AVG 
BANDWIDTH = MIN BANDWIDTH . 

[001 1 3] Not applicable here because A VG BANDWIDTH (610) > MIN 
BANDWIDTH (564). 

[001 1 4] If there are one or more active devices, and any remaining devices 
that are not active, then set ACTIVE BANDWIDTH LIMIT[M] = 0 for the 
remaining devices that are not active. (These remaining inactive devices may still 
use RES BANDWIDTH if they require extra bandwidth during the current 
iteration.) 

[001 1 5] ACTIVE BANDWIDTH LIMIT[508] = 0 (608). 
[001 1 6] FIG. 7 illustrates the following: 

[001 1 7] 3. For each active device, determine the total extra bandwidth, , and 
the number of devices requiring extra bandwidth. 

[00118] Reset DEVICE COUNT = 0, and set PRIORITY COUNT = 0. 
[001 1 9] Extra bandwidth: for each active device M, 

[00120] If TOTAL REQUESTED BANDWIDTH1M1 < ACTIVE BANDWIDTH 
LIMITnvn. then GIVE BANDWIDTHIM! = (ACTIVE BANDWIDTH LIMIT [Ml - 
TOTAL REQUESTED BANDWIDTHrMl). 

[001 21 ] TOTAL REQUESTED BANDWIDTH[500] (512) < ACTIVE 
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BANDWIDTH LIMIT[ 500] (610), so GIVE BANDWIDTH] 500] = (20-10) = 10 (700). 

[001 22] TOTAL REQUESTED BANDWIDTH] 502 ] (5) (522 ) < ACTIVE 
BANDWIDTH LIMIT[502] (610), so GIVE BAND WIDTH [ 502 ] = (20 -5) = 15 (702). 

[00123] TOTAL EXTRA BANDWIDTH = S(0-N¥GIVE BANDWIDTHrMD. 

[00124] TOTAL EXTRA BANDWIDTH (712) = GIVE BANDWIDTH[500] (700) + 
GIVE BANDWIDTH [502] (702) = 25. 

[001 25] Devices requiring extra bandwidth - for each active device M: 

[00126] If TOTAL REQUESTED BANDWIDTHfMl > ACTIVE BANDWIDTH 
UMITfMl. then DEVICE COUNT = DEVICE COUNT + 1. 

[001 27] TOTAL REQUESTED BAND WIDTH [504 ] (532 ) > ACTIVE 
BANDWIDTH LIM1T[504] (604), so DEVICE COUNT = 0+1. 

[001 28] // TOTAL REQUESTED BAND WIDTH [506 ] (542 ) > ACTIVE 
BANDWIDTH LIMIT[506] (606), so DEVICE COUNT =1 + 1. 

[001 29] DEVICE COUNT = 2 (566). 

[00130] If PRIORITYfMl = L then PRIORITY COUNT = PRIORITY COUNT + 
L 

[001 31 ] In this example, no devices have their priority flag set, so PRIORITY 
COUNT =0(710). 

[001 32] FIG. 8 illustrates the following: 
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[00133] 4. If there is extra bandwidth, and devices that require extra 
bandwidth (i.e., (TOTAL EXTRA BANDWIDTH > 0) AND (DEVICE COUNT > 0 
OR PRIORITY COUNT > 0)), then determine an amount that may be added (ADD 
COUNT) to the ACTIVE BANDWIDTH LIMIT[M] for the one or more of the 
devices that require extra bandwidth. In embodiments of the invention, priority 
devices may have higher priority than other devices requiring more bandwidth. 
Therefore, if there are priority devices, these devices may share in the extra 
bandwidth to the exclusion of other active devices requiring extra bandwidth. If 
there are no priority devices, then the devices requiring more bandwidth may share 
in the extra bandwidth: 

[00134] If PRIORITY COUNT > 0, then ADD COUNT = TOTAL EXTRA 
BANDWIDTH/PRIORITY COUNT . 

[001 35] Here, no devices have their priority flags set. 

[00136] If PRIORITY COUNT = 0. then ADD COUNT = TOTAL EXTRA 
BANDWIDTH /DEVICE COUNT. 

[001 37] ADD COUNT = 25/2 = 12.5). 

[00138] In embodiments of the invention, the total ACITVE BANDWIDTH 
LIMITfMI should not exceed (MAX BANDWIDTH - RES BANDWIDTH), so numbers 
may be rounded up or down to the next whole number, as appropriate. 

[001 39] ADD COUNT = 12 (800). 

[001 40] In this example, the number was rounded down, so the total allocated 
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bandwidth = 79 (10, 5, 32, 32) <(80-2 = 80). 

[001 41 ] 5. Decrease the ACTIVE BANDWIDTH LIMIT[M] for those devices 
that have extra bandwidth by GIVE BANDWIDTH[M], and increase the ACTIVE 
BANDWIDTH LIMIT[M] of one or more of the active devices requiring extra 
bandwidth by ADD COUNT. 

[00142] ACTIVE BANDWIDTH LIMnTMl for each of the devices that have 
extra bandwidth is decreased by a corresponding GIVE BANDWIDTHfMl. 

[001 43] ACTIVE BANDWIDTH LIMIT[500J = 20-10=10 (600 ) 

[001 44] ACTIVE BANDWIDTH LIMIT[500] = 20-15 = 5 (602 ) 

[00145] If PRIORITY COUNT > 0. then ACTIVE BANDWIDTH UMITTMl = 
ACTIVE BANDWIDTH LDvimMl + ADD COUNT for each priority device (e.g.. 
devices where PRIORITYrM1=l, those that contributed to PRIORITY COUNT). This 
may be the amount of bandwidth that may be added to each priority device's ACTIVE 
BANDWIDTH LEvimMl to allow it to use more bandwidth. 

[001 46] Here, no devices have their priority flags set. 

[00147] If PRIORITY COUNT = 0. then ACTIVE BANDWIDTH LEvHTfMl = 
ACTIVE BANDWIDTH LIMnTMl + ADD COUNT for each device requiring more 
bandwidth by virtue of having more requests than allocated (i.e., those that contributed to 
DEVICE COUNT). This may be the total amount of bandwidth that may be added to 
each device's ACTIVE BANDWIDTH LIMnTMl to allow it to use more bandwidth. 

[001 48] ACTIVE BANDWIDTH LIMIT[504] = 20+12 = 32 (604 ) 
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[001 49] ACTIVE BANDWIDTH LIMIT[506] = 20 + 12 = 32 (606). 

[00150] In this example, load balancer 304 may allocate ten (10) requests to device 
500, and five (5) requests to device 502 and thirty-two (32) requests to device 504 and 
device 506. Controller 302 may use these allocations to pass requests to device 500, 502, 
504, 506, 508. 

Example 2 - Device Associated With a Priority 

[001 51 ] FIGS. 9-12 illustrate a second example of the exemplary embodiment 
described above. As in Example 1, MAX BANDWIDTH = 82 (960), RES 
BANDWIDTH = 2 (962), MIN BANDWIDTH = 10 (964) and devices 900, 902, 904, 
906, 908 are attached to the controller 302 (not shown in this example). 

[001 52] FIG. 9 illustrates the following: 

[00153] Device 906 has its priority flag set (PRIORITY[906] = 1 (940)). Devices 
900, 902, 904, 908 do not have their priority flags set (PRIORITY [900] = 0 (910); 
PRIORITY[902]= 0 (920); PRIORITY[904] = 0 (930); PRIORITY[908] (950)= 0). 

[001 54] Device 900 may have a total requested bandwidth 912 of 10 requests 
(QUEUE BANDWIDTH = 10 (914); ACTIVE BANDWIDTH = 0 (916)). 

[001 55] Device 902 may have a total requested bandwidth 922 of 5 requests 
(QUEUE BANDWIDTH = 0 (924); ACTIVE BANDWIDTH 926 = 5). 

[001 56] Device 904 may have a total requested bandwidth 932 of 60 requests 
(QUEUE BANDWIDTH = 40 (934); ACTIVE BANDWIDTH = 20 (936)). 
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[001 57] Device 906 may have a total requested bandwidth 942 of 50 requests 
(QUEUE BANDWIDTH = 30 (944); ACTIVE BANDWIDTH = 20 (946)). 

[001 58] Device 908 may have a total requested bandwidth 952 of 0 requests 
(QUEUE BANDWIDTH = 0 (954); ACTIVE BANDWIDTH = 0 (956)). 

[001 59] 1. Set DEVICE COUNT to determine if there are any active devices. 

[00160] DEVICE COUNT may be set to the total number of devices where 
TOTAL REQUESTED BANDWIDTHIM1>0 (i.e., QUEUE BANPWIDTHrMl>0. or 
ACTIVE BANDWIDTH1M1>0). 

[00161] TOTAL REQUESTED BANDWfDTHrMI = QUEUE BANDWIDTHfMI 
+ ACTIVE BANDWIDTHrMl. 

[001 62] TOTAL REQUESTED BAND WIDTH[ 900] (912) = 10 + 0 = 10. 
[001 63] TOTAL REQUESTED BAND WIDTH [ 902 ] (922) = 0 + 5 = 5. 
[001 64] TOTAL REQUESTED BANDWIDTH [904] (932) = 40 + 20 = 60. 
[001 65] TOTAL REQUESTED BAND WIDTH[906] (942) = 30 + 20 = 50. 
[001 66] TOTAL REQUESTED BAND WIDTH [ 908 ] (952 ) = 0 + 0 = 0. 
[001 67] DEVICE COUNT = 4 (966) (900, 902, 904, 906). 
[001 68] RG. 10 illustrates the following: 

[001 69] 2. If there are no active devices (e.g., if DEVICE COUNT = 0), then 
for each device M of 0-N devices, set ACTIVE BANDWIDTH LIMIT [M] = MAX 
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BANDWIDTH - RES BANDWIDTH. 

[001 70] Not applicable, since there are four (4) active devices. 

[001 71 ] If there are one or more active devices (e.g., DEVICE COUNT > 0), 
then set ACTIVE BANDWIDTH LIMIT[M] = AVG BANDWIDTH for the one or 
more active devices. 

[00172] AVG BANDWIDTH = (MAX BANDWIDTH - RES 
BANDWEDTHyDEVICE COUNT . 

[001 73] A VG BANDWIDTH = (82 - 2 )/4 = 80/4 = 20 (1010). 

[001 74] AVG BANDWIDTH (1010) > MIN BANDWIDTH (964). 

[001 75] ACTIVE BANDWIDTH LIMIT[900J = 20 (1000). 

[001 76] ACTIVE BANDWIDTH UMIT[902] = 20 (1002). 

[00177] ACTIVE BANDWIDTH LIMIT[904] = 20(1004). 

[001 78] ACTIVE BANDWIDTH LIMIT[906] = 20 (1006). 

[00179] If AVG BANDWIDTH < MIN BANDWIDTH, then set AVG 
BANDWIDTH = MIN BANDWIDTH . 

[001 80] Not applicable here because A VG BANDWIDTH (1010) > MIN 
BANDWIDTH (964). 

[001 81 ] If there are one or more active devices, and any remaining devices 
that are not active, then set ACTIVE BANDWIDTH LIMIT[M] = 0 for the 
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remaining devices that are not active. (These remaining inactive devices may still 
use RES BANDWIDTH if they require extra bandwidth during the current 
iteration.) 

[001 82] ACTIVE BANDWIDTH LIMIT[908] = 0 (1008). 
[001 83] FIG. 1 1 illustrates the following: 

[001 84] 3. For each active device, determine the total extra bandwidth, and 
the number of devices requiring extra bandwidth. 

[00185] Reset DEVICE COUNT = 0, and set PRIORITY COUNT = 0. 
[00186] Extra bandwidth: for each active device M, 

[00187] If TOTAL REQUESTED BANDWIDTHIMI < ACTIVE BANDWIDTH 
LIMlTlMl, then GIVE B AND WIDTH f Ml = (ACTIVE BANDWIDTH LIMITfMI - 
TOTAL REQUESTED BANDWIDTHM!). 

[001 88] TOTAL REQUESTED BANDWIDTH [900] (912 ) < ACTIVE 
BANDWIDTH LIMIT[900J (1000), so GIVE BANDWIDTH [900] = (20-10) = 10 
(1100). 

[001 89] TOTAL REQUESTED BAND WIDTH [902 ] (922 ) < ACTIVE 
BANDWIDTH LIMIT[902] (1002), so GIVE BANDWIDTH [902] = (20 - 5) = 15 (1102). 

[00190] TOTAL EXTRA BANDWIDTH = £(0-N)(GiVE BANDWIDTH1MT). 

[00191] TOTAL EXTRA BANDWIDTH (1112) = GIVE BANDWIDTH [ 900 ] (1100) 
+ GIVE BANDWIDTH [902] (1102) = 25. 
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[001 92] Devices requiring extra bandwidth - for each active device M: 

[00193] If TOTAL REQUESTED BANDWDPTHfMl > ACTIVE BANDWIDTH 
LIMnTML then DEVICE COUNT = DEVICE COUNT + 1. 

[001 94] TOTAL REQUESTED BAND WIDTH [904 ] (932) > ACTIVE 
BANDWIDTH LIMIT[904] (1004), so DEVICE COUNT =0 + 1. 

[001 95] // TOTAL REQUESTED BANDWIDTH [906] (942 ) > ACTIVE 
BANDWIDTH LIMIT[906] (1006), so DEVICE COUNT =1 + 1. 

[001 96] DEVICE COUNT = 2 (966). 

[00197] If PRIORITY rMl = 1. then PRIORITY COUNT = PRIORITY COUNT + 
L 

[001 98] PRIORITY[906] = 1 (940). 

[001 99] PRIORITY COUNT = 0 + 1 = 1 (1110). 

[00200] FIG. 12 illustrates the following: 

[00201] 4. If there is extra bandwidth, and devices that require extra 
bandwidth (i.e., (TOTAL EXTRA BANDWIDTH > 0) AND (DEVICE COUNT > 0 
OR PRIORITY COUNT > 0)), then determine an amount that may be added (ADD 
COUNT) to the ACTIVE BANDWIDTH LIMITfM] for the one or more of the 
devices that require extra bandwidth. In embodiments of the invention, priority 
devices may have higher priority than other devices requiring more bandwidth. 
Therefore, if there are priority devices, these devices may share in the extra 
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bandwidth to the exclusion of other active devices requiring extra bandwidth. If 
there are no priority devices, then the devices requiring more bandwidth may share 
in the extra bandwidth: 

[00202] If PRIORITY COUNT > 0. then ADD COUNT = TOTAL EXTRA 
BANDWIDTH/PRIORITY COUNT . 

[00203] ADD COUNT = 25/1 = 25 (1200). 

[00204] If PRIORITY COUNT = 0, then ADD COUNT = TOTAL EXTRA 
BANDWIDTH /DEVICE COUNT. 

[00205] Here, PRIORITY COUNT > 0, so this calculation is not used. 

[00206] In embodiments of the invention, the total ACTIVE BANDWIDTH 
LIMnTMl should not exceed (MAX BANDWIDTH - RES BANDWIDTH), so numbers 
may be rounded up or down to the next whole number, as appropriate. 

[00207] Adjustment not needed here. 

[00208] 5. Decrease the ACTIVE BANDWIDTH LIMIT[M] for those devices 
that have extra bandwidth (412) by GIVE BANDWIDTH[M], and increase the 
ACTIVE BANDWIDTH LIMTT[M] of one or more of the active devices requiring 
extra bandwidth by ADD COUNT (414). 

[00209] ACTIVE BANDWIDTH LIMnTMl for each of the devices that have 
extra bandwidth is decreased by a corresponding GIVE BANDWIDTH [Ml. 

[0021 0] ACTIVE BANDWIDTH LIMIT[900J = 10 (1000). 
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[0021 1 ] ACTIVE BANDWIDTH LIMIT[902 ] = 5 (1002 ). 

[00212] If PRIORITY COUNT > 0. then ACTIVE BANDWIDTH UMITTMI = 
ACTIVE BANDWIDTH LIMOTMl + ADD COUNT for each priority device (e.g.. 
devices where PRIORITYrM1=l, those that contributed to PRIORITY COUNT). This 
may be the amount of bandwidth that may be added to each priority device's ACTIVE 
BANDWIDTH LEvim Ml to allow it to use more bandwidth. 

[0021 3] ACTIVE BANDWIDTH LIMIT[906] = 20 + 25 = 45 (1006). 

[00214] If PRIORITY COUNT = 0. then ACTIVE BANDWIDTH LIMIT[M1 = 
ACTIVE BANDWIDTH LIMFITM1 + ADD COUNT for each device requiring more 
bandwidth by virtue of having more requests than allocated (i.e., those that contributed to 
DEVICE COUNT). This may be the total amount of bandwidth that may be added to 
each device's ACTIVE BANDWIDTH LEvinTMl to allow it to use more bandwidth. 

[0021 5] Here, PRIORITY COUNT > 0, so this calculation is not used. 

[0021 6] In this example, load balancer 304 may allocate ten (10) requests to device 
900, five (5) requests to device 902, twenty (20) requests to device 904, and forty-five 
(45) requests to device 906. Controller 302 may use these allocations to pass requests to 
device 900, 902, 904, 906, 908. 

Conclusion 

[00217] Thus, one method embodiment may comprise setting an initial bandwidth 
limit for each of a plurality of active devices associated with a controller. The method 
may additionally include determining a total amount of extra bandwidth from the 
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plurality of active devices that have extra bandwidth, and determining a number of the 
plurality of active devices that require extra bandwidth. If there is extra bandwidth, and 
one or more of the plurality of active devices require extra bandwidth, adjusting the 
bandwidth limit by reallocating the extra bandwidth to the one or more plurality of active 
devices that require extra bandwidth, the adjusting resulting in a bandwidth limit 
corresponding to each of the plurality of active devices. 

[00218] The embodiments described herein may provide a fair method of 
balancing the load on a plurality of devices that are trying to access a fixed amount of 
bandwidth, such as on a controller. By determining and using extra bandwidth, and by 
strategically allocating extra bandwidth to devices requiring more bandwidth, 
embodiments of the invention may reduce and/or eliminate the possibility of one or some 
of the devices capturing a significant amount of the total bandwidth, unfairly limiting the 
bandwidth available to other devices, and decreasing overall performance. 

[00219] In the foregoing specification, the invention has been described with 
reference to specific embodiments thereof. It will, however, be evident that various 
modifications and changes may be made thereto without departing from the broader spirit 
and scope of the invention. The specification and drawings are, accordingly, to be 
regarded in an illustrative rather than a restrictive sense. 
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